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^.rnnE VIA HUMAN-MACHINE INTERFACES 
Ti.,e: Al"OGENERAT^^OFCODE>^^j^, 

TECHNICAL FIELD . 
5 .i™ relates to controlling automated devices vw n 

The present — re.^^ ^ ^ ^^^.^ ,„a/or 

machine interfaces. More pamcularly. the tn^ ^^^^ 
methodology feciUtating automauc generaUon otcontro 

within a HMl. 

BACKGROUND OF THE INVENTION 
eontpletely automat^ in ntany cue— J ^ ^ ^^^^ ,^ 
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— — » manyc— ^^^^ 
plurality oflnput and Output (yO) mo ,,,trol to provide more complex 

Ltactors,re,aysandso^i..^-^^^^^^ 
functions such as Proportronal, Integral and U ^^^^ 

also heen integrated wiOtin the systems, ^^^^^^^^ „ „u.er 

^nnnunicate nctwor. "l,^.,, .stents. Oenerally. 

industrial controllers ufhze the afo 

Imperative to tactory dui ^^rhinerv wherem 

„sa.eandeiac.ent.nterac«onh^— — 

manipulation and control ol -P^^^^ ^ ,Ltrial setUn. a press operator 
^toery occurs via a computer. For examp keyboard. In 

^.U.aHMI.startan.or.psucl.r^^^^^ 

„tt,e. embodiments, fte p«ss can be furthermore. HMIs can be udhzed 

mouse or selecting a virtual button on a touch sc^^ 

. manipulate and/or con«ol ^^l^^^^^:^: „MI can enable a 
.dividualcom^nentsass^ra^w^-P^^^^^^ 

^ operator to — ^^'^ J,, «.idual components re,uired tor 
operation of the press and adjusting par 



accelerating such press. 



HMls not only r^uires desigmng a „s«-«.te,&ce (e,g., P 
a„oni»r.«.»a,~s. ..O.bu.a.so«,u,«ssene«U^^^^^^^^ 

.a/0. a.U»n oon^oUe. an.o. '^^^^^^^^ ^ponLs soft.«. 

.,.n,...ec««ed»interf^econ,pon»^~^^^^ 

rendering. (HMI objects and arrangement of HMI " „ 

3n.otacUo.,andoodeeont.«.S-eo..^^^^ 

oontponentcs) to OP-.^ "^^^^ ^„ 
effectuate desirable operaf on ""^o"^^ . aeUvered 
and further allow components to respond appropriately to op 

to such components via a HMI. i„,,«Bewith 

Cos.^ including programming, latency, meffictency, eu.. 
machinery a^d/or process complexity. SpecificaUy, in an industnal settmg, programmmg 
machmery and/or p hMJ require several hours, and m some 

stances -"'"J ^ ,,^ered inactive. Furthermore, mxhines and/or 

-"trCr:.— ..acecodc — .^^^^^ 
within a HMI for control ofparticular industrial systems and/or processes ar » 

withmaHMiio .,„„„.esses Therefore, after programmmg of 

„otopera,orsofsuchsysten.»d/orp™c^es^^^^^^^^^^^^^^ 

,^e .de and ^-^^^^^l^^^, effici^t and int^tive 

process operator can discover *a m ^^^^^ ^ 

operadon of maclunery, requtnng the operator to 1 

-'-^~^^^:::::rr:rn:rr:;hncsbeforeeffecti. 

t.HMIsisachieve..huscrea.g 

additional expenses. ^ 
1. view of at least the above, mere exists a strong need m th art for y 

.d/or methodology ^^'"^^ "° 
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SUMMARY OF THE INVENTION 

overview of the mvenuon. «„mose is to present some 

inventionnordelineate the scopeofthe invention. Its sole purpose is to p 
invention no „;„.„iified form as a prelude to the more detailed 

concepts of the invention m a simphfied lorm as a p 

description that is presented later. 

systems and/or processes. v.uuc & , j r^laved to 

, A.^ thereafter be automatically generated and relayed to 
process (control code) can thereafter programmable logic 

components of the system comprising processing / J „ 
controller (PLC). Such graphical representation can be ^^^^^^ ^^^^ 
. ,Mthi« a svstem and/or variations in actions of a process, ana con 

present mvenuon thereby enaoiK ,„rt/„r nrocess to customize 

in computer pro^ng but familiar with such system and/or process, 

X 1 n^rpc<;arv for industrial automation. 
^°'"::"a!represe.components..hinanuraustr.a.system,such.a 

Z U 1 actions wiflun an industrial process ie.,.. velocity of a conveyor). A 
pump, as well as action ^ ^ oorrespondmg 

HMI object composes a P"^'™ „ ^.^^e components 

component and/or action, as well as ur^erlyng „tation(s) 

^d/or actions to other components and/or actions. complete with 

.,„MI obiectCs, faciUta.es visually c^nstructins a 

relations between components and/or actions - a ..Ue. »^ 

.sociating components and/or actions to create an mdusmal system and/o 
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ooae. SuchvUual>yoons«uo.«.sys«.a»d/orproc«sc»beutiU^.o 



^T;n";.'o:<.e .0 goven, aoUo. of .he ^ 

,.„.„^™cewitt>oneaspectotthepresen.mve«uon,a»operau>r( 



to aooortooe with one ^ hMI objects vte creating code 

p^ogranuner) .HUed in computet progtannntng - ^^^J^ ^^^^^ 

^ aa^ciatins such cotle to a particular gtap« 

component and/or action. Alternatively, templates can be provtd«i 

,iof<.tiip fields witii parameters of me componcmoi 
populate the fields witn p ^ ^ ^^^^ comprising of 

fields, the template can be saved as a HMI object. P ,f 
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fields, the template can *»v^ p^aohical representations of 

„M.objec.s.U.erehyenablmgause2-^- 2 
a. parametrically ^e.,.. vtsual aspects of a resulting ^ > 
5 color, can be determined). For example, sequencmg of operations can 

^aphicdly rU. utilizing templates. „ 

Furthermore, templates can be uuhzed m conne 
^ arrangements of multiple HMI obj.ts ,in addition to m^- J- » ^ 

or tnstance, templates can comprise arrangements ^mtibe 

t<^«lates^ thereby generation of complex templates mai u 

complex arrangcuii^ nhiects created via 

^^cewtth^otheraspectofthepres^t — 

ThXcalcomUoanti.^ 
^ „as employed to generate * ~ ^^^^^ 

~ TlZ121ponentU.es reduction . manual labor previously 
template. Such histoncai co f understood that instances may 

thereby enabling individual updates of a template. 
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:„ accordance a.o*er aspect of *e present invention. -P""--;^ 
3^Lor process con,prisins efficient inteUigence and/or nten^ory can — 
• rition of HM. objects. Por i^tanee, a. industria. conrponent can co^se a 

■ H ioaholdinsrelevant information regarding the component (eg.. 

ll obiect generator in accordance with one aspect of the present mvent. n. 
ZIZ^ eomponentcsjcomprisingmemory-thememorystoringinformatron 

likew se automattcally generatea. ror»A«i y ..™.„„„t(s^ 
. H/„r nrocess information, such as component location, adjacent component(s), 

rr:::---B— of . ^u.. ,.^^^o. ^ -or 

'"^.n accordance with another aspect of the present invention existing HMI objects 
^.eeditedbyacomputerpro^cr. — 7^"'^' Tbe 
se.e« an existing HMI object and be provided with code mtd.ly.ng the HMI object. 

^ih .uch code in accordance with vanations m 
computer propammer can modrfe- such code m 

,0 component(s) and/or action(s) wthin -^^^^^^^^^^ , 
can be saved in a library compnsir« various HMI objects ana m gr 
rlentationofasystemand/orprocess. Alternatively, a template compnsmg 
Il^llds coLponding to component and/or acUon paramet^ can - ^"ded. 
It emplate facilitates KM. obj«t editing by an operator not sidUed m comput^ 
« tZig, but familiar with a component and/or action graphicaUy represented b a 

25 programming, uu Hp<:irablv in occurrences of 

:::r::::rrar;r^^^^^ 

ZltZrisingdisparatepar^eters. S-P'V 
e^tuategene^tionofaHMIobjectcorrespondingtotheup^adc^omi^^^^ 

o««thf.r asnect of the present mvention, two or more nmi 
OA In accordance with another aspeci 01 uio F 

„,ectscanbecombinedasas.g.eHMIobjec,therebyreducingvisualcluttero„a 
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and thereafter associate such arrangement with a graphical p 

^eo. of *e invenUo. The. a.peo. are Mca«ve. h„wev«. c b„. a few o ^e^^ 

_es and novel features of to invention will be»me apparent fern me fo.lowng 
"Icripaon Of the invention w.t» — -Junotion v.ti, the drawn.. 

BWEF DESCRIPTION OF THE DRAWINOS 
Fig. 1 is a block dia^am of a code generating system in accordance with an 

1 s aspect of the present invention. 

Fig 2 is an exemplary graphical display illustrating an arrangement of HMI 

objects in accordance with an aspect of the present invention. 

Fig 3 is an exemplary graphical display illustrating an arrangement of HMI 
obj««s in accordance wiflr an aspect otthe present invention. 

Fig. 4 is a representative flow dia^ iH— generation of contiol code 

variance wim an aspect of the present invention ^ ^ 

Fig 5 is a block diagram of a code generating system wherem HMI > 

created and/or edited in accorfance witir » aspect of the present inventioa 

Fig. 6 is a flow diagram for editing HMI objecU in accordance wrth an aspect 

" ""T^lt^aiagramofasystemforautomaticallygenerat.^^ 

accordance wifli an aspect of the present invention. 

8 is an exemplary block dia^ of a network of components m conjunction 
with an object generator in accordance with an aspect of the present invention. 
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Pig , is an exemplary ^bica. dispUy iUustraUng con*ination of ,wo or more 
HMI obiec;s i».o a single HMI obJeC in accordance wifl. an aspec, of U» present 

'"'"'"g. 10 is an exemplary graphical display illustrating HMI object creation in 
, accordance with an aspect of the present invention. 

5 accorodnv-c i j-.„i,vniii^tratine HMI object creation in 

Fig. 1 1 is an exemplary graphical display illustrating tuvu j 

accordance with an aspect of the present invention. 

Fig. 12 is a flow diagram for creating HMI objects v.a a template m accordance 

with an aspect of the present invention. 
10 Fig 13 is an exemplary graphical display iUusUating HMI object «d.tmg ,n 

accordance with an aspect ofthe present invention. 

Fig. 14 is an exemplary graphical display illustrating HMI object cdrttng m 
accordance with an aspect of the present inventioa 

Fig. 15 illustrates an example operating environment in which the present 

"~:r:— cblocl.dtagram„fasample^n.pu^ 
which the present invention can interact. 

DETAILED DESCRIPTION OF THE INVENTION 
T^e present invention is now described wim reference to the drawing, wheretn 
ii^e reference ntunerals are used to refer to ^e elements throu^out. h. 
.escriptton, for purposes of explanation, num«ous specific detatls are set for^m order 
.provideathoroughunderstandingofthepresentinvention. 
however that the present invention may be practiced without these spectfic deta Is. In 

l illances, l^own structures and devices are shown in bloc, diagram fotm m 
order to feciUtate describing the present invention. 

AS used in this appUcaUon, the term "computer component" is mtend^to refer 
. computer-related entity, either hardware a combinaUon of hardware and sof^a«^ 
. Je. or software in execution For example, a computer componen may be, but ,s 

„ot.^ted.obein.aprocessrn.u.sona,„»«^.a^^^^^^^^ 
executable,athreadofexecution,aprogram,and/oracomputer. by y 
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.oU, an appUcation ™™ng on a serve, and fl,e se^er can be a 

One or more computer components may reside within a process and/or 
;:::tionandalponentmay.e.ocaU.edon„necompu.erand/ordis.ributed.e.«.en 

two or more computers. 

The subject invention can incorporate various inference schemes and/or 
techniques in connection with effecting a user interface for object management and 
manipulation. As used he«in, the term "inference" refers generaiiy to the process o 
masoning about or inferring states of the system, —en, and/or user from a s^ of 
observations as caphrred ria evenU and/or data. Inference can be employed to . enufy 
sp^ific context or action, or can generate a probabiUty distribution over states, for 
example. The inference can be probabilistic - that is, the computation of a probabrhty 
distribution over states of interest based on a consideration of data and events. Infer»ce 
can also refer to techniques employed for composing higher-level events from a set of 
events and/or dat. Such inference results in the consttuction of new events or actions 
torn a set of observed evenu and/or stored even, data, whether or not tite events are 
correlated in close temporal proximity, and whether the event, and data come from one 
or several event a»i data sour^. Various classification schemes and/or systems e.g., 
support v^^tor machines, neural networks, expen systems, Bayesian belief ne^»orks, 
tezy logic, data fusion engines...) can be employed in comtection with performmg 
automatic and/or inferred action in comaection with the subject invention. 

Referring now to the drawings, Fig. 1 Ulnstrates a hitft-level system overvrew m 
co^ection with one particular aspect of the subject invention. The present i— 
..ates to a novel system for generating control code witinn a HM. util^mg ftmConal 
HM. objects (..g., graphical representations of components and/or actions wtthrn an 
industiial system and/or process). Code generating system 100 facilitates enabhng an 
industrial system and/or process operator to design and implement an automated system 
and/or process without requiring experi prog^uning skrlls. The system 100 compnses a 
oode generator 102 that includes aHMI analyst 104. The HMI analyzer 104 ftctUtates 
analysis of HMI objects. HMI objects are graphical representations of indnstrtal system 
components and/or actions of corresponding industiial system components and/or process 
actions Furthemtore, HMI objects can be associated with contiol code (eg., code 
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Lpresentotions of component and/or actions. For instance, a HMI ^^"^ 
lnsre.ting.oapun.pca„bea^pWca.rendcri„gofap™^p.and.d^^^^^ 

govennng operation of such pnn>p can be d^ca.ed to *e graphrca. dep.cuon of toe 
174 Objects can include but are not lintited to grapbical representations of s>^te» 
Znents an^or 6n.ctiona, descriptions of a »e.hodo.ogy. For ex™.p.e, an nnage o 
rje as well as a fiutctional block describing actions desirably taken by a valve can be 

accordance witb an aspect of.be present invention. Tbe HMI ob^ts can 

be stori and displayed in a location accessible by a user for ^ting, arrangmg, and 
:Xlon. FLarnpl. a library of HMI objects can be displayed on a .onttor v« a 

HMI and stored within a data store (not shown). 

1 accot^oe witi, one aspect of the present inv^tion, HMI objects are created 
w an individual skilled n. computer pro^annning (e..., a compute pro^amnter scrtpts 
L for each component »d/or action repres«,ted by a HMI object). Furtitennore, 
des c. be elployed to facilitate creating desired HMI objects by a system an.or 
Zss operator not skilled in computer pro^. S«cb tempUes can be provided 
I inntitively provide an operator witi, fields for effectively ftcilitating c^attor, o 
,.1^ HMI object. Altent^ively. components comprising a system and^ PJ - 
controlled via a HMI can comprise sufficient mtelligence and/or memory to facth^te 
:;:LionofHM.objects.Forexample.amacbinecomponentcanbee,„.pp«l«^ 

:^ess.g device .eluding memory, wboein tite memory is populated — »t 
mformation to fi^ilitate self-creation of HMI objects (..g., memory assoctated a 
p^cular component can include component parameters, components c^e.^ ^ 
Lectcomponent,processesutilizingsuchcomponent....). Commumcating such 
"araml to tire system 100 cables gen^tion of HMI objec. representing 
ZcompoLts and^or anions of components. Moreover, tite system 100 can^loy 

artificial intelligence means to intetrogate device memory and — ^^'^ 
objects, wbe^ingivenaparticularuser state .dcontexttitesystemlOOcantf^whtch 

^ Objects, as well as type of HMI object, to cate (.g., an "•'j-^— a 
component, an action, a process, ...). A communication protocol defined by 
oomponent can also be employed in connection witi. interrogating the component 
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„,>^,ity of HMI obiocts fton. a data store or Ubrary comprrsmg s„ h HMI ob^ts. 

r .nrdiw of HMI objects can be arranged to ftaKtionaUy represent a 
wherem the plurality ot HMI oojec ^„i™<. a orocess to consist 

Ai^r.mccss For example, an operator desiring a process lu 

LL HMI objects des^ibing acts of such process. In another example, 
'i:.:ror— t.gcomponen.ofan.dustn.systemcangr^^^^^^^ 

„.reUUonshlpsbetweensuchoon^entswi«i.thc^- 

^e HMI analyst .04 analyses an '^'^J^^Z Z,. 1- 
a^ngemen. of HMI objects to a code generator 102, wta h fa 
..baseda.least.partupon.ca^.s^- 

ra:::.=i"--^^^^^ 

determine feasibiUty of implementing such an arrangem^t mto 

HMI arrangemem, fTT^yrTnhiects cannot be implemented 

^'^-^ rr^Titr: ressage to . ^ 

:rp.::::i"-r.ame.odoi^^ 

r ^h methodology is incompatible «ith components comprising me system. 
:Z:— ^occur«hendesign.HMIobject<s>comprrsep— not 

— crri::::=:":o.oanbereiayed. 

::iT— — -ses.con^^^^^^ 

created by the code generator 1 02 can be stored m memory of a PLC and can b 
created by m s instruction jumping, loopmg, mterrupt 

by the PLC in a sequential manner, aimougii 
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ana -p-e ^ of — . exa.p>e, ^ a.so — — 

■,. , m^,^ can be generated by the code generator 104. U IS to oe 
e^atible w.th tnost PLCs) can ge Y 
. ^u,od, however, that u.il,zat.o„ of a PIX; '^^^ ^ 
, andisnottncanttobehn^tinginanytn^^aso^e^^^^^ 

:::r:xrr dins.str.t^^..— ---- 
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'^"^ Meet — enablesanindustrialsyste^and/orprccessoperatorto 

graphically rep „„^„ control code, thereby substantiaUy mittgatmg 

mohicalrepresentattonvwgeneratmg control w 

decencies which require eKper. c„n,.-«cr progranuners to generate c«le 

t esses and/or systen. of which they are — ■ Therefore, .ndus^al 

can be ef^ienUy .d .expensive., aCeved. . . ope«»r of a syst» 

fo«i;iiar with a system can design control coae uiai guv^ 
" lUer parUctdar aspect of the present invention, in an instance 

accordance with ' ^ ^ , HMI object, such component 

desired component and/or act has not been 

and/or act can be scripted by a programmer and assi^ed as a HMI , 
apro^anm.ercancreatecontro,coderegardinganact.onofapump,andd^c^^^^ 

llH^aobiecttha.ca„be»«.izeabyamachineoperatorto^ap^y— ^» 

process utilizing such pump. Furthetntore. control code — 
lited and re-dedicated as a HMI object (either idenHcal or ^^^^^^^^^^^ 
HMI object). EnabUng editing and dedicating of HMI objects er^ure 
Z can be flexible as components and/or actions of an industna, system and/or proces 

rrrsystem 100 does no. need to be replaced when industrial processes change or 
^ ted) Moreover two or more HMI objects can be combined into a smgle 

systems are updated). Moreover, tw „f , ^d/or process. 

HMI object to simplify an operator's graphical representation 

, ,„,li.vofHMI objects created and arranged to rq-resent a pamcular 

For example, a plurality 01 mvii uuj „ «f hmt nhiects 

p^cess can be combined into a single HMI object and saved m a hbrary of HMI objects 
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for later and repeated use. The combined HMI object can thereafter be fragmented into 
the original HMI objects at an operator's discretion. 

A HMI utilized in conjunction with the subject invention can be a fixed HMI, for 
example, such as a graphical interface on a stationary monitor used in conjunction with a 
personal and/or industrial computer. According to another example, the HMI can be a 
tethered portable HMI, such as the Machine Terminal MT750 or the Guard Terminal 
G750, both manufactured by Allen-Bradley. A tethered portable HMI offers several 
advantages over the fixed HMI. the most unportant being increased mobility to manually 
inspect the plant floor with the HMI in hand, thus permitting increased productivity. For 
example, an operator using a tethered portable HMI can respond to alarms and/or adjust 
machine settings with the HMI in hand. Increased mobihty fiirther enables greater 
troubleshooting capability and reduced set up time. 

According to another example, the HMI comprising the subject invention can be a 
wireless HMI. wherein the term "wireless HMI" is meant to encompass any mobile 
computing device utilized in connection with wireless network communication (e.g., 
laptops, tablets, PDAs. . . .). A wireless HMI offers even greater mobility than the 
tethered portable wireless, and its range can be extended by distributing additional base 
stations throughout a large plant, hi this mamier. an operator can access informaUon 
regarding a given machine and control the machine from any point in the plant. 
Furthermore, several wireless computing devices operate on a thin cUent platform, which 
permits facilitated integration to new or extant control architectures. By utilizing this 
technology, the wireless computing device can act as a thin client to computer 
applications. Because communication with a server occurs via a network link, this aspect 
of the present invention advantageously reduces hardware and software costs. 

Turning now to Fig. 2. an exemplary graphical display 200 {e.g., displayed on 
computer monitor, television screen, portable monitor. . . .) facilitating arrangement of 
HMI objects representing a particular system is illustrated. The display 200 comprises an 
exemplary library 202 of differing HMI objects available to enable creating a graphical 
representation of a system. The library 202 comprises N HMI objects, wherem HMI 
object 204 represents the Nth HMI object, and each HMI object represents different 
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components of a system. The display 200 further comprises an arrangement region 206 
to enable an operator to configure HMI objects to graphically represent a desired system. 

In the illustrated example of Fig. 2, HMI objects 208. 210, and 212 are arranged 
by an operator to graphically represent an industrial system, wherein control code for 
governing actions and/or components represented by the arrangement can be desirably 
generated by a code generator 102 (Fig. 1) based at least in part on such arrangement. 
The arrangement can be created via operator selection and transfer of HMI objects from 
the HMI library 202 to the configuration section 206. The HMI objects can be selected 
and transferred via mouse, keystrokes, touch screens, or any other suitable manner for 
selecting and transferring objects. HMI objects can be provided with input/output ports 
correspondmg to inputs and outputs of a machine component that a particular HMI 
component represents, thus enabling an operator to easily generate a graphical 
representation of a system. For example, HMI object 208 can comprise an input 216 and 
an output 218. wherein the input 216 is comiected to an output 220 of HMI object 210, 
and the output 218 is comiected to an input 222 of HMI object 212. Display 200 can 
further comprise a comiection portion (not shown) which can include means of 
comiecting HMI objects, such as comiection 224 between the input 216 of HMI object 
208 and the output 220 of HMI object 210. While the exemplary objects 208, 210 and 
212 are illustrated with one input and one output, respectively, graphical representations 
of system components that include a plurality of inputs and/or outputs falls within the 

scope of the present claims. 

Upon completion of the graphical representation 214. the configuration section 

206 can relay the graphical representation 214 to the HMI analyzer 104 and the code 
generator 102 (Fig. 1) to generate control code for a system corresponding to the 
graphical representation 214. An operator can communicate to the arrangement region 
206 that the graphical representation 214 is complete via mouse, keystrokes, touch 
screen, or any other suitable mamier of communicating to the arrangement region 206 
that thl graphical representation 214 is complete. System automation can therefore be 
enabled without requiring an expert computer programmer to generate control code for a 
system. 
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RegardingFig. 3, an «™plary graphical display 300 facilitating anangcm«t of 
HMI objects representing a particular methodology is iUust^ted. The display 300 
comprises m exemplary library 302 of differing HMI objects available to create a 
^Mcalrepresentationofamethodology. The library 302 includes N HMI objects, 
lerein HMI object 304 represents the Nm HMI object, and «.h HMI object represents 
generic fimctiona. descriptions of a methodology. The display 300 tather compr.es an 
atangement region 30« enabling operator configuration of HMI objects to graphically 

represent a desired methodology. 

Exemplary method 308, comprising HMI objects 310, 312, and 314, whrch 
represent particular acts of a mett»dology. can be created by selecting particular HMI 
objects torn the library 302 and transferring such HMI objects to tire arrangement regton 
306 The HMI objects 3 10. 3 12. and 3 14 comprising tire methodology 308 can be 
as^eiated with one anote v« any smtable connecting means. Upon communicating ^ 
are configuration section 306 that a desired methodology has been created utih^ng HM 
objects, the HMI analyzer 104 and the code generator 102 (Fig. 1) can create control code 
for faciUtating automation of component actions required for an industrial process to 
operate according to the desired methodology. While Figs. 2 and 3 illustrate exemplary 
displays comprisingHMI objects tita. represent components of a system and acts of a 
metitodology. respectively, a display can comprise a combination of boti. HMI objects 
representing system components and HMI objects representing acts of a methodobgy. 

Turning now to Fig 4, a methodology 400 for generating code torn a HMI 
representation of a system and/or process is illustrated. While, for purposes of simplrctty 
of explanation, tire meti»dology is shown and described as a series of acts, tt .s to be 
understood and appr^iated that the pr^en, invention is not limited by tire order of acts, 
as some acts may. in accordance witi, tite present invention, occur in different orders 
and/or concurrentiy wim other acts from that shown and described herein. For example, 
those skilled in the art will understand and appreciate that a methodology could 
alternatively be represented as a series of interreUted states or events, such as m a state 
diagram. Mor^vcr, no. all iUust^ted acts may be re,uirrf to implement a methodology 
in accordance wifli the present invention. 
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At 402, a graphical arrangement of HMI objeets representing a system and/or 
process is received by a component capable of analyzing such arrangement. The 
anangement can be created by an operator utiUzing a Ubrary of HMI objects and means 
to associate such HMI objects (eg., cormeoting apparatuses). Alternatively, arufical 
intelligence techniques can be utiUzed to facilitate generating an anangement of HMI 
objects based upon user state, context, and other extrinsic data. For example, grven a 
particular user, a determination car, be made regarding creation of a graphtcal 
representation by reviewing components within a system and prior graptacal 

representations genaated by the user. 

At 404 the arrangement of HMI objects is analyzed {e.g. . components necessary 
for implementing a method can be identified, related components of HMI objects can be 
reviewed, feasibility of implementing such anangement into control code,. . .). Error 
messages can occur, if upon analysis, an arrangement of HMI objects desirably 
effecmated within a system is found inteasible. At 406, control code is generated based 
in part upon the analysis. The control code can be generated in C, C++, C#, Java, 
HTML, XML, perl, e,c. and can be formatted in any suitable manner (e.g.. ladder logic. 

) Generated code can be relayed to system components comprising a suitable 
processing device (e.g., a PLC, microprocessor, ...). Various processing devices can act 
conjunctively to facilitate operability of a system and/or process appUcatton vw 
controlling one or more machine component(s). 

In accordance with one aspect of the present invention, intelligent components 
can be employed to enable control code to be automatically generated in a desnabk 
programming language, and thereafter automatically compiled into executable code 
suitable for a given processing device. Alternatively, die type of control code to be 
generated can be selected by a user and thereafter automaticaUy compUed accordmg to 
knowledge of type of processing device fl>at will utilize the control code. Furthermore, 
disparate languages and/or executable code fomtats can be selected for different HMI 
objects and/or different portions of a control system under development. Such intelhgent 
components enable support for new programming languages and/or processing devrces to 
be added without requiring entire systems to be upgraded to new vcions (e.g.. a new 
intelligent component can simply be added). 
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m accordance with another aspect of the present invention, intelligent components 
can be utilized to output a universal language that can be translated into any desirable 
programming language and/or executable code for known processing devices. The 
universal language mitigates a requirement to output a same portion of control code 
numerous times. Rather, the control code can be output a single time, and thereafter 
converted to any desirable programmmg language and/or executable code. Furthemiore, 
pre-configured HMI objects and/or control strategies can be supplied to a system m the 
universal language, thereby allowing use of the HMI objects in any end system regardless 
of particular programming language(s) and processing device(s) utilized by the system. 

Generated code can be associated with a graphical representation of HMI objects 
and saved in a data store, thereby alleviating a potentially necessary re-generation of the 
same code later in time. For example, a system and/or process operator can create a 
particular arrangement of HMI objects, utihzed to facilitate generating control code 
corresponding to such particular arrangement, and the subject invention can relay the 
control code to components comprising a processing device, as well as concurrently save 
the generated control code in a data store. Through saving the generated control code and 
corresponding particular arrangement of HMI objects, the code can be employed to 
control operation of a system and/or process after reconfiguration of a processing device 
{eg. after changing processing devices, control code alterations,...). Furthermore, 
associating a HMI arrangement with generated control code facilitates simplistic editing 
for similar processes, thereby enabling an operator lacking expert programming skills to 
quickly alter code controlling an industrial system and/or process. For example, an 
operator can add and/or remove HMI objects to and/or from a HMI arrangement 
corresponding to generated control code, and thereafter generate control code based on 

the edited arrangement of HMI objects. 

Turning now to Fig. 5, a system 500 utilizing created and/or edited HMI objects 
to generate control code is illustrated. The system 500 includes a code generator 502 
comprising a HMI analyzer 504. The HMI analyzer 504 receives arrangements of HMI 
objects, and analyzes such arrangement to ensure feasibility. The code generator 502 can 
then create control code corresponding to the arrangement of HMI objects received by 
the HMI analyzer 504. 
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The system 500 further cotnprises a HMI object creator/editor 506. whieh 
faciUutes creating new HMI objects and/or editing existing HMI object located in a data 
store 508. New HMI objects can be created by a user sufficiently skilled in computer 
programming, wherein a HMI object can be coded utiUzing any suitable program 
language and a corresponding graphical representation of the HMI object can be 
associated with such code, thereby creating a HMI object. Alternatively, a template can 
be provided, mus allowing a user not skiUed in computer programming to populate flelds 
within the template corresponding to component and/or action parameters. The cr^ 
objects can be stored in the data store 508 for later use, and arranged together w.th 
existmg and/or edited HMI objects to create a graphical representation of a control 
system and/or process. Allowing creation of HMI objects facilitates flexibility in system 
and/or process design, and furth« enables consumers to augment an extstmg system 
and/or process with additional components and/or acts without necessitating purchase of 
an upgraded HMI. 

Moreover, the HMI object creator/editor 506 facilitates editing of existmg HMI 
objects in accordance with one aspect of the present invention, an operator skilled m 
computer programming can directly acce^ and edit code underlying HMI objects (eg., 
editing code corresponding to a graphical representation of a component and/or act 
results in editing of a HMI object). Alternatively, a template can be utilized to effemate 
editing of a HMI object. For example, upon selection of a HMI object yia a selectmg 
device (..g., a mouse, keystrokes, touchscreen,. . .). a template comprising a ptaraUty of 
alterable fields that define parameters of a component and/or act repre^nted by the HMI 
object can be provided. An operator lacking expert programming skills can thereafter 
desirably alter such fields to effectively create a new HMI object. Templates utilized for 
editing HMI objects are typically most useful during occurr«>ces that a component and/or 
act is slightly modified (e.g.. an obsolete component is replaced with an upgrade 
component comprising similar parameters). Furftermore, the HMI object creator/ednor 
506 faciUtates a multi-user development enviromnent. For example, two or more 
operators at affering locations can act in conjunction with one another to desirably edtt a 
HMI object. 
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Now regarding Fig. 6, a methodology 600 for editing HMI objects is illustrated. 
At 602 HMI objects are received. In accordance with one aspect of the present invention, 
a Ubrary of HMI objects is stored in a data store. Alternatively, industrial components 
can include processing devices comprising sufficient intelligence and/or memory 
allowing for self-creation of HMI objects {e.g., processing devices can relay sufficient 
component parameters thereby allowmg a HMI to infer a HMI object). At 604, a HMI 
object editor is enabled. In accordance with one aspect of the present invention, a 
graphical display on a display device can illustrate such editor via selecting a HMI object 
utilizing a selecting device (e.g., mouse, keystrokes, touch screen,. . .). Moreover, a HMI 
object editor can be an entirely disparate application, thereby requiring an operator to 

initiaUze the editor separate firom a HMI. 

At 606, HMI object(s) are edited. In accordance with one aspect of the present 
invention, code underlying a particular HMI object can be accessed and modified within 
a HMI object editor, thus editing the HMI object. Alternatively, a HMI object editor can 
present a template comprising modifiable fields that define parameters of a component 
and/or action represented by a HMI object, thereby facilitating HMI object editing by an 
operator not skilled m computer programming {e.g., an operator can alter parameters 
within a template). At 608, edited HMI objects are saved, allowing later utilization 
and/or editing of modified HMI objects. For example, saved HMI objects canbe 
included in a HMI object library, wherein an operator can select such HMI objects for 
inclusion in an arrangement of HMI objects representing a system and/or process. 
Thereafter the arrangement can be utilized to facilitate generating control code and 
relaying such code to components comprising processing devices, thereby governing 
components and/or actions components of systems and/or processes. 

Turning now to Fig. 7, a system 700 facilitating self-generation of HMI objects is 
illustrated. System 700 comprises processing device(s) 702 including memory 704, an 
object generator 706, a data store 708, and a code generator 710 comprising a HMI 
analyzer 712. The processing device(s) 702 include memory 704 that stores data sheets 
associated with component information, such as component identity, surrounding 
components, actions of the component, systems including such component, etc. hi 
accordance with one aspect of the present invention, the component information within 



18 



03SW170 



10 



the memory 704 of the processing device(s) is automatically relayed to the object 
generator 706, which utilizes such component information to generate HMI objects 
and/or arrangements of HMI objects representing an industrial system and/or process. 
For example, the object generator can receive information from a plurality of components 
comprising a system, and utilize such information to faciUtate creation of HMI objects 
representing such plurality of components, as well as generate an arrangement of such 
HMI objects thereby graphically representing the system comprising such components. 
Plug-and-Play technologies, as well as other similar methodologies, can be utilized to 
automatically relay component information to processing device(s). Furthermore, the 
component information and generated HMI object(s) and/or arrangements(s) can be 
relayed to the data store 708 for later utilization. 

In accordance with another aspect of the present invention, the object generator 
706 can employ various artificial intelUgence techniques to interrogate the processing 
device(s) 702 and/or arrange generated HMI object(s) to represent a system and/or 
15 process. For instance, tiie object generator 706 can request information from the 

processing device(s) 702 to identify a component, and based upon results of the request 
can interrogate such processing device(s) 702 as well as other processing devices with 
particular inquiries necessary to facilitate creation of a HMI object and/or arrangement of 
HMI objects. Such particular inquiries can reduce bandwidth required for generating 
HMI objects and/or arrangements, reduce traffic on a system bus, increase manufactunng 
efficiency, etc. TTxe object generator 706 can also utilize artificial intelligence techniques 
to generate an arrangement of HMI objects based on operator state and context. For 
example, an individual operator may retain security clearance to operate particular 
systems witiiin specific areas. The object generator 706 can therefore determine the 
25 operator identity and location togetiier with available components to create an 
arrangement of HMI object(s) available to the particular operator. 

The generated HMI object(s) and/or arrangement(s) of HMI object(s) can 
tiiereafter be delivered to the code generator 710 comprising the HMI analyzer 712. The 
HMI analyzer 712 can determine feasibility of such object(s) and/or arrangement(s), 
wherein if such object(s) and/or arrangement(s) are infeasible, a message can be relayed 
to the object generator 706 to create different HMI object(s) and/or arrangements. 
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Ofte^ise. to code generator 710 can generate control code facilitating govemmg o 
actions of a system and/or process represented by HMl object(s) and/or arrangement(s) 
^ relay such control code to components comprising the processmg devices 702. 
Moreover, the code generator 710 can relay control code to the data store 708 for later 

Utilization and/or editing. 

Tummg now to Fig 8, an exemplary system 800 of compo,«nts compnsmg 
intelligent automation devices is iUustrated. While for purposes of explanaUon 
provable logic controUers (PLCs) are illustrated as the in..llig«.t automation 
devices, it is to be mtderstood that such inteUigent automation devices can be valves, 
^rs, actuators, drives (motors), ^ any other suitable intelligent automation devtces. 
System 800 comprises an object generator 802 tor creating HMI objects based at least m 
part upon information obtained ftom processing devices. System 800 comprises a 
pl„raU.yofcomponents804,whereineachcomponentincludesaPLC806. Whrle 

system 800 illustrates PLCs 806 as processing devices employed to control actions of the 
components 804, any suitable processing device can be utilized within the scope of the 
subject claims (e.g.. microprocessors, various miciocontroUers,...). 

The syst™ 800 facilitates communication between the PLCs 806 and ttte object 
generator vi« a data bus 808 - such bus utilizing any suitable connection employable to 
.lay data. For example, a cable comtection, wireless comtection, Ethernet connection 
etc can all b. utilized as a data bus to facilitate communication between PLCs 806 and 
fl,c object generator 802. The PLCs comprise memory tirat includes component 
information (e.g., component identification, connected components, component actions, 
) to accordance with one aspect of flte present invention, a plurahty of PLCs wtthm 
system 800 can relay infom««on regarding components 804 to ti>e object generator 
802 thereby enabling the component generator 802 to create HMl objects representmg 
such components 804 and/or systems and/or processes comprising ttte components 804. 
to accordance with another aspect of Ute subject invention, the object generator 802 can 
employ artificial intelUgence t^hniques to interrogate the PITs 806, resulting m 
obtaining requisite information for creating HMI objects representing the components 
804 Furthermore, ttte object generator 802 can infer systems and/or processes 
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comprising components 804 ™ reviewing operaU>r smte and context, syst«n and/or 
process state and context, as well as other extrinsie data. 

Now regarding Fig. 9, an exemplary ^hioal display 900 facilitaUng effecuvely 
grouping aplurdity of HMI objects into a single HMI object is iUustrated. Display 900 
comprises a Ubrary 902 otN HMI objects, wherein HMI object 904 is the first HMI 
object and HMI object 906 is the Nth HMI object. It is to be nnderstood that while 
display 900 displays a Ubrary comprising HMI objects, any suitable means tor stonng 
and/or displaying HMI objects is within the scope of the hereto appended clanns. An 
operator cm select HMI objects from the library 902 and place the HMI objects into an 
arrangement region 908 vte any suitable selection means (e.g., mouse, keystrokes, touch 

screen,...)- 

As illustrated in exemplary dispUy 900, an operator has selected HMI objects 
910 912 and914ftomthelibrary902andtransfe.r»ltheHMlobjects910.914intothe 

arnmgement region 908. It is to be understood, however, that transferal of the HMI 
■ objects 910-914 to the arrangement region 908 does not remove the HMI objects 910-914 
from the library 902. Rather, the pariicular HMI objects 910-914 can remam avatlable 
tor additional use in the arrangement region 908 and/or in later arrang«nents of HMI 
objects. Furthermore, HMI objects 910-914 have been graphically atfiUat^l wth one 
another via comtecting means 916. In acconiance with one aspect of the present 
invention, a library of comrectrng means (not shown) is provided, thereby allowmg an 
operator to select an appropriate connecting means U> affiliate two or more HMI objects. 
Alternatively, artificial intelligence means can be provided to effectuate graphical 
relationships between two or more HMI objects based on operator state and context, as 
well as other extrinsic data (eg., proximity of HMI objects to one another). In 
combination, HMI objects 910-914 create a single assemblage 918 of HMI objects. 

An operator can inform a HMI that the assemblage 918 of HMI objects is 
desirably created via any suitable selecting means (eg., selecting all HMI objects 
desirably in flie assemblage 918). Upon creation of tiie assemblage 918. the operator can 
r^me »d store the assemblage 918 mto tt-e Ubrary 902 as a single HMI object. ti.e«by 
aUeviating visual confosio. fl». ean occur upon presence of numerous HMI objects. The 
operator-defined HMI object (eg., tiie assemblage 918) can be utiUzed m a larger 
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arrangement of HMI objects, which represents a system and/or process, and dehvered to 
a code generator, wherein control code is created to govern actions of components wxthm 
such system and/or process. Furthermore, the operator-defmed HMI object can be 
removed and/or edited to add and/or remove HMI objects, change parameters, etc. In 
accordance with one aspect of the present invention, a new template can also be 
generated via creating an operator-defined HMI object. 

Turning now to Fig. 10, an exemplary graphical display 1000 facilitating 
operator-creation of a HMI object is illustrated. Graphical display 1000 comprises a 
library 1002 of N HMI objects, wherein HMI object 1004 is the first HMI object and 
HMI object 1006 is the Nth HMI object. Graphical display 1000 fiarther comprises a 
creating region 1008, which facilitates creating a HMI object representing an act and/or 
component via operator programming. For example, a component and/or act can be 
added to a system and/or process, wherein a HMI object representing such additional 
component and/or act does not presently exist within a HMI. The present invention 
enables an operator to create and name a HMI object representing a component and/or act 
within the creating region 1008, thereby enabling a HMI to represent relevant 
components and/or acts within a system and/or process. 

A field 1010 can be provided to facilitate creating code miderlymg a HMI object. 
The code can written in any suitable language {e.g., C, C++. Fortran, Java, C#, Visual 
Basic, Sequential Function Charts, Structured Text, Function Blocks . . .) and any smtable 
format {e.g., ladder logic). Furthermore, a graphical representation of the code 
populating field 1010 can be named and stored in the library 1002 for later utilization 
and/or editing. For example, code underlying a created HMI object can be presented m 
an editing region (not shown) thereby allowing an operator to change parameters, 
configurations, etc. to maintain consistency with variations in components and/or acts 
represented by such HMI object. Furthermore the created HMI object can be utilized m 
an arrangement of HMI objects in connection with other HMI objects and relayed to a 
generating component (not shown), thereby facilitating creation of control code to govern 
actions of a system and/or process represented by such arrangement of HMI objects. 
Now regarding Fig. 1 1, an exemplary graphical display 1 100 facilitating creation of a 
HMI object via a template is illustrated. Display 1 100 comprises a library 1 102 of N 
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HMI objects, wherein HMI object 1 104 is the first HMI object and HMI object 1 106 is 
the Nth HMI object. Display 1 100 fiirther comprises a creating region 1 108. which 
provides a template 1 1 10 to facilitate operator-creation of a HMI object representing a 
component and/or act within a system and/or process without requiring the operator to be 
5 skilled in computer programming. The template 1110 comprises a plurality of fields 

1112-each field lll2representingaparameterof a component and/or act. An operator 
can populate each field to create a new HMI object representing a component and/or act, 
as well as name and store such HMI object in the library 1 102 for later utilization and/or 

editing. 

10 While Fig. 1 1 illustrates generation of the template 1110 parametrically (e.g.. 

populating particular fields with parameters), it is to be understood that the template 1110 
can be generated utilizing graphical components, thereby enabling a user to control an 
output HMI object graphically as well as parametrically {e.g., visual aspects of a resulting 
HMI object, such as size, shape, and color, can be determined). For example, sequencing 
1 5 of operations can be controlled graphically via utilizing templates. 

Furthermore, the template 1 1 10 can be created to generate arrangements of 
multiple HMI objects (in addition to individual HMI objects). For instance, the template 
11 10 can comprise arrangements of disparate templates {e.g.. links or references to other 
templates), thereby generating a complex template 1 1 10 that describe complex 
20 arrangements of HMI objects 1 104 - 1 106 to be created via arranging multiple templates 
(not shown). In accordance with another aspect of the present invention, HMI objects 
1 104 - 1 106 created via the template 1 1 10 can include a historical component (not 
shown) that links the HMI objects 1104- 1106 created by the template UlOtothe 
template 1 1 10. The historical component can thereafter propagate alterations to the 
25 template 11 10 to the HMI objects 1104 -1106, thereby allowing several HMI objects 
1 104 - 1 106 to be updated automatically by simply altering the parent template 1110. 
Such historical component facilitates reduction in manual labor previously required to 
update the HMI objects 1 104 - 1 106. Furthermore, it is to be understood that instances 
may occur when a user simply desires to update the template 1110 without updating HMI 
30 objects 1 104 - 1 106 created via the template 1 1 10. hi such instances the historical 
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component can be disabled. Aereby enabUng ^ template 1110 to be updated without 
consequence to the HKfl objects 1 104 - 1 106 created via the template 1 110. 

An additional library (not shown) comprising a plurality of templates can be 
employed, wherein each template can be customized to represent general components 
and/or acts. For example, a template can be provided specifically for creation of a press - 
each field of the template being relevant to presses (e.g., press size, compression 
power,. ..). Furthermore, an operator can create a eustomized template if a component 
and/or act not present at the creation of a HMI becomes pertinent to operation of a system 

and/or process. 

Turning now to Fig. 12, a methodology 1200 for creating a HMI object via a 
template is illustrated. At 1202 a template is enabled. In accordance with one aspect of 
the present invention, separate templates exist for specific components and/or acts withm 
a system and/or process. For example, a template can be provided specifically for a 
press Typically, a template comprises several fields desirably altered by an operator, 
thereby facilitating operator-creation of a HMI obj ect without requiring the operator to be 

skilled in computer programming. 

At 1204 fields of the template are populated with parameters corresponding to 
components and/or acts that are to be represented by the HMI object. For instance, fields 
can be populated with parameters such as adjacent components, operating speed, or any 
other parameter relevant to an act and/or process. Upon population of requisite fields, the 
template can be named and stored as a HMI object for later editing and/or utilization 
ie.g., the created HMI object can be employed in comiection with disparate HMI objects 
to create an arrangement representing a system and/or method). 

RegardingFig. 13, an exemplary graphical display 1300 facilitating editing of an 
existing HMI object is illustrated. The display 1300 comprises an arrangement region 
1302 wherein HMI objects representing components and/or acts can be arranged to 
represent a system and/or process. Arrangement region 1302 comprises an assemblage 
1304 of a plurality of HMI objects representing a system and/or process. The assemblage 
1304 includes a HMI object 1306 that is desirably edited by an operator. Upon selecting 
the HMI object 1306 via any suitable selecting means, a HMI editor 1308 can be 
provided. 
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The HMI editor 1308 comprises alterable code underlying the selected HMI 
object 1 306. thus enabling an operator sufficiently skilled in computer programming to 
modify an existing HMI object 1306 in an instance in which a component and/or act 
represented by the HMI object 1306 has been altered or replaced. For example, a 
component within a system can be replaced by a similar component possessing ability to 
operate at a greater velocity. Enabling editing of the HMI object within the assemblage 
1304 allows an operator to modify control of a system and/or process without having to 
redesign the entire system. Furthermore, the edited HMI object 1 306 can be stored m a 
Ubrary comprising disparate HMI objects for later utilization and/or editing. For 
example, the edited HMI object 1306 can be employed in conjunction with differing HMI 
objects to create an assemblage of HMI objects representing a system and/or method. 
Such assemblage can be delivered to a code generator (not shown) for creating control 
code that governs actions of individual components within a system and/or process. 

Referring now to Fig. 14, an exemplary graphical display 1400 facilitating editing 
of a HMI object via a template is illustrated. Display 1400 comprises an arrangement 
region 1402, wherein HMI objects representing components and/or acts can be arranged 
to represent a system and/or process. Arrangement region 1402 comprises an assemblage 
1404 of a plurality of HMI objects representing a system and/or process. The assemblage 
1404 includes a HMI object 1406 that is desirably edited by an operator. Upon selecting 
the HMI object 1406 via any suitable selecting means, a HMI editor 1408 can be 
provided. 

The HMI editor 1408 comprises a template 1410, wherein the template 1410 
includes a plurality of modifiable fields 1412 populated with parameters correspondmg to 
a component and/or act represented by the HMI object 1406. An operator can modify 
entries within the fields 1412 analogous to parameter variations of components and/or 
acts ie g. a component is replaced by a similar component with disparate parameters). 
Ttie template 1410 facilitates editing of the HMI object 1406 by an operator lacking skill 
m computer programming, thereby mitigating expenses incurred via hiring of expert 
computer programmers. Furthermore, the edited HMI object 1406 can be named and 
stored in a HMI object Ubrary (not shown) for later editing and utilization. For example, 
several substantially identical obsolete components within a system can be replaced with 
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updated components. Storing an edited HMI object representing such updated 
components only requires editing the HMI object a single time - thereafter the edited 
component can simply be selected from a HMI object library and inserted mto a HMI 
object assemblage (representing a system and/or process). 

II, accordance with another aspect of the present mvention, rather than providmg 
fields 1412 to edit the template 1410, graphical components (not shown) can be provided 
to facilitate editing of the template 1412. For instance, a user can control an output HMI 
object graphically as well as parametrically {e.g.. visual aspects of a resulting HMI 
object, such as size, shape, and color, can be determined). Furthermore, sequencmg of an 
operation defined by the template 1410 can be modified graphically. The template 1410 
can also be edited to effectiiate "nesting" of other templates into the template 1410. For 
example, links or other references can be embedded to other templates can be embedded 
into the template 1410. thereby facilitating creation of complex arrangements of HMI 
objects to be created via arranging multiple, simple templates. 

HMI objects created from the template 1410 and/or the template 1410 can 
comprise a historical component (not shown) that links tiie HMI object to tiie template 
1410 utilized to create such HMI object. Thereafter, modifications to the template 1410 
can be propagated to HMI objects created via the template 1410. Tlius. numerous HMI 
objects canbe updated by simplymodifying the template 1410. It is to be understood, 
however, tiiat tiie historical component can be enabled and/or disabled in individual HMI 

objects and/or individual templates. 

In order to provide a context for tiie various aspects of tiie invention. Figures 15 
and 16 as well as the following discussion are intended to provide a brief, general 
description of a suitable computing environment in which tiie various aspects of ttie 
present invention can be implemented. While tiie invention has been described above m 
tiie general context of computer-executable insfructions of a computer program tiiat runs 
on a computer and/or computers, tiiose skilled in the art will recognize tiiat the invention 
also can be implemented in combination witii otiier program modules. Generally, 
program modules include routines, programs, components, data structures, etc. tiiat 
perform particular tasks and/or implement particular abstract data types. Moreover, tiiose 
skilled in tiie art will appreciate ttiat tiie inventive methods may be practiced witti otiier 
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computer system configurations, including single-processor or multiprocessor comp«t« 
systems, mini-computing devices, mainftame computers, ss well as personal computers, 
hand-held computing devices, microprocessor-based or programmable consumer 
electronics, and the Uke. The illustrated aspects of die invemion may also be practiced m 
distributed computing enviromnents where tasks are performed by remote processmg 
devices that are Unked through a communications network. However, some, .f not all 
aspects of the invention can be practiced on stand-alone computers. In a distributed 
computing «>viromnent. program modules may be located in both local and remote 

memory storage devices. 

Withreterence to Fig.l5. an exemplary enviromnent 1500 for implementing 
various aspects of the invention mcludes a computer 1512. The computer 1512 includes 
aprocessingm.it 1514, a system memory 1516,andasystembus 1518. Thesystembus 
1518 couples system components itKluding. but not limited to, tire system memory 1516 
to fl» processing unit 1 5 14. The procesdng unit 1 5 14 can be any of various available 
processors. Dual microprocessors and other multiprocessor architectines al^ can be 

employed as the processing unit 1514. 

The system bus 15 18 can be any of several types of bus sttucmre(s) including the 
memory bus or memory controller, a peripheral bus or external bus. and/or a local bus 
using any variety of available bus architectures including, but not limited to, 1 1-bit bus. 
Mustiial Standard Architecmre (ISA). Micro-Channel Architecmre (MSA). Extended 
ISA (EISA). InteUigent Drive Electionics (IDE), VESA U>cal Bus (VLB), Pertpheral 
Component hrterconnect (PCI), Universal Serial Bus (USB), IEEE 1394, Advanced 
Graphics Port (AGP), Personal Computer Memory Card totemational Association bus 
(PCMCIA), and Small Computer Systems Inter&ce (SCSI). 

The system memory 1516 includes volatile memory 1520 and nonvolatile 
memory 1 522. The basic input/output system (BIOS), containing a« basic routines to 
transfer information between elements wifliin the computer 15 12, such as during start-up, 
is stored m nonvolatile memory 1522. By way of iUusttation, and not limitation, 
nonvolatile memory 1 522 can include read only memory (ROM), programmable ROM 
(PROM) electiically programmable ROM (EPROM). electtically erasable programmable 
ROM (EEPROM), or Hash memory. Volatile memory 1520 includes random access 
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memory (RAM), which aots as external cache memory. By way of iltetration and ,K,t 
limitatton. RAM is available in many forms such as synchronous RAM (SRAM), 
dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM 
(DDR SDRAM), enhanced SDRAM (ESDRAM). Synchlink DRAM (SLDRAM), and 

direct Rambus RAM (DRRAM). 

Computer 1512 also includes removableMon-removable, volatUe/non-volat.le 
computer storage media. Fig. 15 illustrates, for example a disk storage 1524. Disk 
storage 1 524 includes, but is not limited to, devices like a magneHc disk drive, floppy 
disk drive, tape drive, Jaz drive. Zip drive, LS-lOO drive, flash memory card, or memory 
stick In addition, disk storage 1 524 can include storage media separately or m 
combination with other storage media including, but not limited to, an optical drsk dnve 
such as a compact disk ROM device (CD-ROM), CD recordable drive (CD-R Dnve), CD 
rewritable drive (CD-RW Drive), a distal versatUe disk ROM drive (DVD-ROM). DVD 
recordable drive (DVD-R). DVD rewritable drive (DVD-RW), and any other smiable 
DVD drives. To facilitate comtection of the disk storage devices 1 524 to the system bus 
1518 aremovable or non-removable interface is typically used such as interface 1526. 

' It is to be appreciated that Fig. 15 describes software that acts as an intemiediary 
between users and the basic computer resources described in suitable operating 
environment 1500. Such software includes an operating system 1 528. Operating system 
1528 which can be stored on disk storage 1524. acts to control and allocate resources of 
the computer system 1512. System appUcations 1530 take advantage of the management 
of resources by operating system 1528 through program modules 1532 and program data 
1534 stored either in system memory 1516 or on disk storage 1524. It is to be 
appreciated drat the present invention can be implemented with various operating systems 

or combinations of operating systems. 

A user enters commands or information into the computer 1512 through mput 
device(s) 1536. Input devices 1536 include, but are not limited to. a pointing device such 
as a mouse, trackball, stylus, touch pad. keyboard, microphone, joystick, game pad, 
satelUte dish, scanner, TV tuner card, digital camera, digital video camera, web camera, 
and the like. These and other input devices comiect to the processing unit 1514flu.>ugh 
the system bus 1518 Wa interftce port(s) 1538. bterfece port(s) 1538 include, for 
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example, a serial port, a parallel port, a game port, a universal serial bus (USB), an ffiEE 
1394 port, and a Small Computer Systems Interface (SCSI) port. Output device(s) 1540 
use some ofthe same type ofports as input device(s) 1536. Thus, for example, a USB 
port may be used to provide input to computer 1512, and to output mformation from 
computer 1512 to an output device 1540. Output adapter 1542 is provided to illustrate 
that there are some output devices 1540 Uke monitors, speakers, and printers, among 
other output devices 1540, which require special adapters. Hie output adapters 1542 
include by way of illustration and not limitation, video and sound cards that provide a 
means of comiection between the output device 1540 and the system bus 1518. It should 
be noted that other devices and/or systems of devices provide both input and output 

capabilities such as remote computer(s) 1544. 

Computer 1512 can operate in a networked enviromnent using logical comiections 
to one or more remote computers, such as remote computer(s) 1544. The remote 
computer(s) 1 544 can be a personal computer, a server, a router, a network PC, a 
workstation, a microprocessor based appliance, a peer device or other common network 
node and the like, and typically includes many or all ofthe elements described relative to 
computer 1512. For purposes of brevity, only a memory storage device 1546 is 
illustrated with remote computer(s) 1544. Remote computer(s) 1544 is logically 
comiected to computer 1 5 1 2 through a network interface 1 548 and then physically 
connected via communication comiection 1550. Network interface 1548 encompasses 
communication networks such as local-area networks (LAN) and wide-area networks 
(WAN) LAN technologies include Fiber Distributed Data Interface (FDDI), Copper 
Distributed Data Interface (CDDI), EthemetAEEE 1102.3, Token Ring/IEEE 1102.5 and 
the Uke WAN technologies mclude, but are not limited to, point-to-point hnks, circuit 
switching networks like Integrated Services Digital Networks (ISDN) and variations 
thereon, packet switching networks, and Digital Subscriber Lines (DSL). 

Communication comiection(s) 1550 refers to the hardware/software employed to 
comiect the network interface 1548 to the bus 1518. While communication comiection 
1550 is shown for illustrative clarity inside computer 1512. it can also be external to 
computer 1512. The hardware/software necessary for comiection to the network mterface 
1548 mcludes, for exemplary purposes only, mtemal and external technologies such as. 
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modems including regular telephone grade modems, cable modems and DSL modems, 

ISDN adapters, and Ethernet cards. 

Fig. 16 is a schematic block diagram of a sample-computing enviromnent 1600 
with which the present invention can interact. The system 1600 includes one or more 
cUent(s) 1610. The client(s) 1610 can be hardware and/or software (e.g., threads, 
processes, computing devices). TTie system 1600 also includes one or more server(s) 
1630. The server(s) 1630 can also be hardware and/or software (e.g.. threads, processes, 
computing devices). The servers 1630 can house threads to perform transformations by 
employing the present invention, for example. One possible communication between a 
client 1610 and a server 1630 may be in the form of a data packet adapted to be 
transmitted between two or more computer processes. The system 1600 mcludes a 
communication framework 1650 that can be employed to facilitate communications 
between the client(s) 1610 and the server(s) 1630. The client(s) 1610 are operably 
connected to one or more client data store(s) 1660 that can be employed to store 
information local to the client(s) 1610. Similarly, the server(s) 1630 are operably 
comiected to one or more server data store(s) 1640 that can be employed to store 

information local to the servers 1630. 

What has been described above includes examples of the present invention. It is, 
of course, not possible to describe every conceivable combination of components or 
methodologies for purposes of describing the present invention, but one of ordinary skill 
in the art may recognize that many fiirther combinations and permutations of the present 
invention are possible. Accordingly, the present invention is intended to embrace all 
such alterations, modifications and variations that fall within the spirit and scope of the 
appended claims. Furthermore, to the extent that the term "includes" is used in either the 
detailed description or the claims, such term is intended to be inclusive in a manner 
similar to the term "comprising" as "comprising" is interpreted when employed as a 
transitional word in a claim. 
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